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Abstract 

The physical motivation and rigorous proof of convergence for a particular network of 
nonlinear coupled oscillators are reviewed. Next, the network and convergence proof are gener¬ 
alized in several ways, to make the network more applicable to actual engineering problems. It 
is argued that such coupled oscillator circuits are more natural to implement in analog hardware 
than other types of dynamical equations because the signal levels tend to remain at sufficiently 
large values that effects of offsets and mismatch are minimized. Examples of how analog imple¬ 
mentations of these networks are able to address actual control problems are given. The first 
example shows how a pair of coupled oscillators can be used to compensate for the feedback path 
phase shift in a complex LMS loop, and has potential application for analog adaptive antenna 
arrays or linear predictor circuits. The second example shows how a single oscillator circuit with 
feedback could be used for continuous wavelet transform applications. Finally, analog CMOS 
implementation of the coupled oscillator dynamics is briefly discussed. 


This research was supported in part by the National Science Foundation’s Engineering Research 
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Program, under grant AFOSR-90-0105 and AFOSR-F49620-92-J-0500. Also, the authors ac¬ 
knowledge the Office of Naval Research for their support of this work. Finally, this work was 
partially supported by a National Science Foundation Graduate Fellowship. 
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1. Introduction 


Networks of coupled oscillators have been proposed for various applications, including 
locomotion (specifically, central pattern generators) [1], pattern recognition (for instance, dis¬ 
tinguishing between different objects in view simultaneously), and biological information pro¬ 
cessing (as a solution to the dynamic binding problem [2,3,4,5]). There is evidence that coupled 
oscillator networks play a role in biological systems^]’, but the point of view taken in this work 
is that the mathematical analysis of coupled oscillator networks can also yield networks which 
are useful in their own right for applications in pattern recognition and control. In particular, 
coupled oscillator networks, with their generally large and predictable signal levels, appear to 
be better suited to analog VLSI implementation than other dynamical systems because offset 
and mismatch problems, which lead to large relative errors at small signal levels, are minimal 
at large signal levels. 

The basic network examined in this paper is given by 

Vi = x i )“ 

\ x j\ 

x i = Y,yk w *jk> j = !,■■■,« (i) 

k i 

where Xj and are complex numbers Vj, Wjk are fixed complex interconnecting weights with 
Wjj = 0 Vj and Wjk = w (i.e., the weight matrix is Hermitian), /3 is a scalar parameter, and 
r(-) : [0, oo) —>■ 3ft is a memoryless strictly monotone increasing nonlinearity with r(0) = 0 and 
linim^oo r(m) = 1 (later to be specified precisely) [8]. r(-) is also assumed to be analytic, and 
the function *{p\z wik : C —> C is a well-defined function which compresses the magnitude 
of its complex argument while retaining its angle. 

For the j th unit (or oscillator), y 1 may be thought of as its state, and Xj represents its 
input from the rest of the network. Because the states are complex, each unit carries both phase 
and amplitude information, and it is the phase information which is of primary interest. In the 
coupled oscillator context, the phases of coupled oscillators oscillating at the same frequency are 
represented. 
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The reason for choosing these dynamical equations is that they represent a very simple 
method of defining a coupled-oscillator network. The input to each unit is the weighted sum 
of the states of the other units, where the weights themselves are complex (and thus may alter 
the phase as well as the amplitude of the signals they weight). The input to each unit is then 
passed through a memoryless saturating nonlinearity whose gain is a parameter, and the result 
is then low-pass-filtered to produce that unit’s state. 

It turns out that the oscillator network described by (1) can be derived from a mean-field 
analysis of a stochastic physical oscillator problem, as discussed by Zemel, et. al. [8]. Fur¬ 
thermore, the physical motivation leads to a Lyapunov function which can be used to rigorously 
prove stability of the network, in the sense that every trajectory must converge to an equilibrium 
point in the ambient space 5ft 2 ” in which the complex Xj, j = 1, ...,n, evolve [9,10]. 

However, to proceed further, careful examination of the form of the Lyapunov function 
is required. The main contribution of this work is an explanation of three ways in which the 
dynamical equations can be modified, but for which the Lyapunov function can also be modified 
to retain the convergence property. With these generalizations, the coupled oscillator network 
is much better suited to potential real-world applications. 

With the convergence analyses complete, the focus turns next to simple examples illustrat¬ 
ing how such networks can be usefully applied to high-speed analog circuit problems. The first 
example shows how a pair of coupled oscillators can be used to compensate for the feedback path 
phase shift in a complex LMS loop, and has potential application for analog adaptive antenna 
arrays or linear predictor circuits. The second example shows how a single oscillator circuit with 
feedback could be used for continuous wavelet transform applications. Finally, analog CMOS 
implementation of the coupled oscillator dynamics is briefly discussed. Application of nonlinear 
coupled oscillator theory to high-speed analog circuits is a recent development [11,12]. 
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2. Fixed-Weight Network Analysis 


2.1 Introduction 

The dynamics given by (1) can be rewritten solely in terms of the Xj variables: 

% = fll 

k 

= -J2yk w jk + J2 r ^\ x k\)-rn w *jk 

k k ' k ' 

= ( 2 ) 

These dynamics were proposed and physically motivated by Zemel, et. al. [8]; however, their 
proof of convergence was incomplete. After a review of the physical motivation, a rigorous proof 
of convergence, in the sense that each trajectory asymptotically converges to an equilibrium point 
of the dynamics, will be presented (see, for earlier versions, [9,10]). Furthermore, it is shown 
that convergence of (2) implies convergence of (1), even if the weight matrix is not invertible. 

2.2 Physical Motivation 

Zemel, et. al. propose first a stochastic network of directional units (complex-valued ran¬ 
dom variables with magnitude one and angle representing directional information) intercon¬ 
nected by complex weights which are considered fixed'-’p§. The directional units evolve accord¬ 
ing to probability distributions determined by the other directional units and interconnecting 
weights. The stochastic network is then simplified using the mean-field approximation to give 
a deterministic network. The purpose of examining the stochastic network is that it provides 
insight for the stability analysis of the deterministic network. 

To begin the stochastic network analysis, consider a network of directional units, each 
represented by a random variable Zj taking values on the unit circle in the complex plane. 
The directional units are interconnected by fixed complex weights Wjk satisfying Wjj = 0 and 
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Wkj = w* k . Defining x 1 = J2k z k w *jk represent the interaction of unit j with the rest of the 
network, the angle of Xj is related to the mean value of Z v and the magnitude of Xj is inversely 
related to the variance of Zj (the precise dependence to be determined below). 

Next, a quadratic form representing “energy” in terms of unit states and interconnecting 
weights is defined: 

£(z) = -Vwz*=-^ ¥ | % , z = (z 1 ,...,z n ) T . (3) 

Because W is hermitian (i.e., w k j = Wj k ), E( z) is real-valued. (This definition of energy 
generalizes the Hopfield energy function for binary units [8].) Using Xj = J2k z k w jk arl( l changing 
to polar coordinates: Xj = a,je ia i and z 3 = (recall that \zj\ is constrained to equal 1), we 
define 

= — a,j cos (4>j — aj) (4) 

as unit j’s contribution to the total energy. Then E( z) = \ z). (Observe that when 

the angle of Xj is aligned with the angle of z v unit j is in a low-energy state.) Introducing a 
“Boltzmann factor” fJ (interpreted as the reciprocal of temperature), and taking the probability 
density that the jth unit is in a state Zj = e 1 *’ to be proportional to e~^ E ^ z \ we obtain: 

f Zj (zj) oce^ cos ^-^), (5) 

where Zj , the state of unit j, is a random variable taking values on the unit circle in the complex 
plane and fzj(-) is a probability density function. Appropriate normalization gives 

where /o(') is the modified Bessel function of the first kind and order zero. This is known as the 
Von Mises, or circular normal, distribution, and it is a distribution for circular random variables 
having some characteristics similar to the usual normal distribution for linear random variables 
[13]. A circular normal distribution is completely characterized by two parameters: a mean 
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direction (f> gj| 0 - 27r) and a concentration parameter m > 0 which corresponds to the reciprocal 
of the variance of a linear normal random variable. 

Next, Zemel, et. al. apply a mean-field approximation to come up with a deterministic 
network model. In the mean-field approximation, the random variables Zj are replaced by their 
means y 3 =<Zj> and are treated as independent (even though they are, in fact, highly coupled). 
The mean <Zj> of a Von Mises random variable is a complex number y } = r' 3 e n -> with 7 j = 
and r 3 = . Figure 2.1 shows r ? as a function of rrij : it is strictly monotone increasing, 

passes through the origin, and satisfies lirn mj rj (nij ) = 1 . 



Figure 2.1: Plot of 77 = (from [5]).» 


The dynamics for the deterministic network are chosen to be 

dxj ^—\ j. . . 

+l^ywjk ( 7 ) 

k 

so that at equilibrium, Xj = Y.k Vk w ]k- ana l°gy with the expression Xj = J2k z k w jk f° r the 
stochastic network. Furthermore, yj = r(/J\x 3 \)^. so that if r, is viewed as determining the 
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mean and concentration parameter of a Von Mises distribution according to (6), yj will be the 
mean value of the distribution. The deterministic dynamics can be expressed in terms of the Xj 
alone as: 


dxj 

dt 




( 8 ) 


The total energy for the deterministic network is found by taking the mean of the total 
energy expression for the stochastic network (and assuming the units are independent): 

< E >=-lj2yjy*k w jk- ( 9 ) 

1 j,k 

Furthermore, the “entropy” for the deterministic network is found by summing the entropies of 
the individual units of the stochastic network (again using the independence assumption): 

H = J2 + lo g( 27r/ o(/3aj))| ■ (10) 

With these definitions of <E> and H . a Lyapunov function corresponding to what Zemel 
et. al. call “free energy,” F =<E>—TH. T = jj. can be computed, and this Lyapunov func¬ 
tion can be used to prove convergence of the deterministic network using LaSalle’s invariance 
principle. 


2.3 Proof of Convergence 


As will now be shown, the deterministic dynamics (2) are convergent: every trajectory 
converges to an equilibrium point. LaSalle’s invariance principle is invoked to prove this, and a 
Lyapunov function based on the physically motivated “free energy” is used. 


Letting xf = Re(xj) and xj = Im(xj) we can rewrite the dynamics as 
xf = -xf+ Y j r{P\x k \)- 


„ x k w Tk + x kPi k 


ij = -x] + ^:mx k \) XkW i k XkW >\ j = 1,. 

k \ Xk \ 


( 11 ) 
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which gives a well-defined vector field on R 2n , the state space for purposes of the proof of con- 

q>R yyR 'W ^ 

vergence. (If x k = 0, we take r(/3\x k \) k 3 \ Xk \ k ,k = r W\ x k\) k lk \ X k \ lk = 0-) The equilibrium 
points of the dynamics are points where if = x[ = ... = if = i^ = 0. 

At any point in the state space SR 2 ”, except where xf and Xj are both zero for some j, we 
can define a valid (nonsingular) change of coordinates by xf + iXj = aje ia i , j = 1, In the 
new coordinates, the dynamics become: 

a,j = '^%fr Y r{/3a k )b jk co s(a k - aij - 6 jk ) 

k 

a.j = — Y r (P a k)bjkain{a k -ctj - 0,*). (12) 

a i k 

where - iw' jk = bj k e l6 i k . 

At all points in R 2n where the change of coordinates is valid, we define the Lyapunov 
function (simply the free energy <E>—TH, T = -|): 

v = ~Y cos (a* - ay - 6 jk ) 

j<k 

-TY[-P a i r (P a s) + log (2nIo(f5a j ))] (13) 

where log denotes the natural log. (Keep in mind that Wj k = w* k ,-. Wjj = 0, and ft = ^.) It turns 
out that V can be continuously defined even where the change of coordinates is singular, because 
if either a,j or a k is taken to be zero in the above formula for V, the term r{fiaj)r{j3a k )bj k cos(a k — 
a.j — 6j k ) will be zero regardless of the value of ay or a k . Let v 1 = a r . i = 1,2, ...,n and 
Vi +n = aii, i = 1, 2,..., n. 

Calculating F(i') = ^-z>, we obtain 

= -Y\p r \P a i)^- a i±'Y r (P ak ) b i kCos(a k -aj-e jk ) 

Y r(/3a k )b jk sin(a k - ay - 0 jk ) 




(14) 





0, and 


Note that r(fla 3 ) > 0 Vaj > 0 and > 0 Vaj > 0. Also, r'((3a,j ) —> ^ as a,j —> 

(3r'((3a,j) as a 1 -» 0. 

Thus, V’(i') <0 Vaj > 0 Vet,. and V’(i') = 0 if and only if 

{ ~ a i + r{(3a k )h k cos(a fc - d, - 0,*) = 0 
^r{f3a k )b jk s : m{a k -a j -6 jk ) = Q Vj 

k 

But this will hold at a point Xj = a$$ a > Vj where the change of coordinates is valid if and only 
if it is an equilibrium point of the dynamics. 


We now show that the Lyapunov function V(u) has bounded sublevel sets, because this 
will enable us to exhibit compact sets which are positively invariant under the dynamics, as 
required to apply LaSalle’s invariance principle. Observe that the first term of V, 

- r(0<*i)r(P. a k)l>tk cos {a k - - 6 jk ), (16) 

j<k 

is bounded as <ij • > oo for any (or all) a v A straightforward but lengthy calculation shows that 
fiajr{fiaj) — log (2nIo{/3aj)) *# 00 as a,j — >■ 00. Then because (3ajr((3aj) — log (27rio(/3aj)) > 
0 Vaj > 0, and because the terms /3a,jr(a,j) — log (2?r/o(/3a,-)) appear summed in V, it follows 
immediately that V is radially unbounded in the a 3 (where by definition V : 5R n —>■ 5R is radially 
unbounded in its argument a E if V(a). • > 00 as ||a|| —>■ 00 (lij). Moreover, since V is 
continuous even at points where the change of coordinates is singular, we can conclude that V 
has bounded sublevel sets when viewed as a function of ...,x^,x^). 

So far we have shown that there is a Lyapunov function V continuous on all of 5R 2n , which 
has bounded sublevel sets, and which has V(v) < 0 provided v is not an equilibrium point and 
provided v is not a point where our change of coordinates is singular. What we will now show is 
that there is no loss of generality in assuming that a trajectory will pass through points where 
the change of coordinates is singular only at isolated points in time. 

Specifically, we will show that if a trajectory has xf{t*) = Xj(t*) = 0 for some j E {1,..., n} 
and for some t* then either t* is an isolated point in time for which xf = 
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xl = 0 or else 




xf = Xj = 0 Vi > 0. If xf = Xj = 0 Vi > 0, then simply eliminate the xf and Xj coordinates 
and consider the reduced system of dimension SR 2 ” -2 . Repeating this test will reduce the system 
to a new system with coordinates (xf, x[, ....xjf. xf) with h <n. The trajectories of the reduced 
system will have xf(t*) = Xj(t*) = 0 only at isolated time instants i*. and hence we will have 
V = 0 only at equilibrium points and at isolated times i*. (It is easy to verify that the reduced 
system has exactly the same form in terms of dynamics, equilibria, and Lyapunov function as 
the original system.) 

Analyticity properties are the key to showing that the system can be reduced so that 
xf = Xj = 0 for some j only at isolated points in time. That the right-hand-side of the 
differential equation for (xf (f), x[(t), .... xf(t). xl^fy)). equation (11), is analytic in the variables 
xf, x[,..., xf, x^ follows straightforwardly from basic properties of analyticity (using methods in, 
e.g., [15]). This in turn implies that the trajectory (xf (f), x[(t),..., xf(t), x^(t)) is an analytic 
function of t (the necessary results on analyticity and differential equations can be found in 
[16]). Therefore, for any j E {l,...,n}, (xf,xj) will be an analytic function of t. Hence if 
xf{t*) = Xj(t*) = 0 then either t* is an isolated point in time for which xf = Xj = 0 or else 
xf = x] = 0 Vi > 0. 

We have a well-defined, C°° (in fact, analytic) vector field (11) on 5R 2n and a Lyapunov 
function V which has bounded sublevel sets. For simplicity, think of the vector field abstractly, 
as given by i> = f{v), with Lyapunov function V(v). Also, V{v) < 0 along trajectories. 

Fix c > 0 and let 

n c = {y G < c}. (17) 

In order to apply LaSalle’s invariance principle, the chief control theory tool which applies to 
this problem, we need to show that fl c is a compact positively invariant set. We have already 
shown that the Lyapunov function has bounded sublevel sets, and hence ft c is bounded. In fact, 
it can be easily shown that is closed as well, and hence is compact. Positive invariance of fi c 
follows from the fact that V{v) <0 along trajectories. 
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Theorem 2.1 (LaSalle’s invariance principle): Let fl be a compact set and suppose the 
solution v(t) starting in S2 stays in Q. for all t > 0. Let V : Q —>■ 5ft be a continuous function such 
that V(i '(f)) is a monotone nonincreasing function of t. Let E be the set of all points in where 
V(u) exists and equals zero. Let M be the largest invariant set in E. Then v(t) approaches M 
as t ‘-f'QO. 


Proof. (See [14].) 

Theorem 2.2: The dynamics (11) converge to an equilibrium point. 

Proof: For any initial condition i/q, reduce the system if necessary so that we may assume 
that the coordinate transformation is only singular at isolated points in time. Also, choose c > 0 
to be greater than or equal to V(uq). Then the set in Theorem 2.1 is taken to be as defined 
earlier, which is a well-defined compact subset of 5R 2n when viewed in (a:f, x[, ..., x„, x £) coordi¬ 
nates. Because the vector field is well-defined, the Lyapunov function is monotone nonincreasing 
along trajectories, and the set fi c is compact, it follows that the trajectory v{t) exists and stays 
in fi c Vf > 0. Thus, the hypotheses of Theorem 2.1 are satisfied, enabling us to conclude that 
the trajectory will converge to the largest invariant subset of the set of points in such that 
V(v) = 0. But the largest invariant subset of the set of points with V(v) = 0 are just the 
equilibrium points of the system which lie inside fi c . 

LaSalle’s Principle thus enables us to conclude convergence of any trajectory to the set of 
equilibrium points of the dynamics, but not to a specific equilibrium point. We will now show, 
by appropriate choice of inner product, that the system follows gradient dynamics except at 
isolated points in time. At points v = (ai,..., a n , «i,..., a n ), define the inner product: 

= v l T diag(/3r'(/3ai),..., /3r'(/3a„), air(/3ai), ..., a„r(/3a„))u 2 , (18) 

where vl and u 2 are two tangent vectors at the point u. Then {v,v v ) = —d v V ■ v v = (—'VV,v ll ) 
so that u = — W; i.e., the system satisfies gradient dynamics (except at isolated time instants). 
Thus, we may conclude that in fact the dynamics (11) converge to an equilibium point. Q.E.D. 
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2.3 Application of Convergence Result 


The convergence result just proved implies the convergence of the complex dynamics (2). 
An additional argument is required to conclude that the dynamics of equation (1) converge. 
Because the Xj converge to constant values, the terms 

(is) 

\ x i\ 

also converge to constant values (by continuity). Now consider the system 

Vj = ~yj+ u ii ( 20 ) 

which is clearly globally asymptotically stable if the Uj are constant. Because the x :) trajectories 
remain bounded, so do the u 3 , and it is not hard to see that the u 3 remaining bounded implies 
that the yj trajectories also remain bounded. Therefore, the y 7 asymptotically converge to an 
equilibrium point [17]. 

2.4 Generalization to a Class of Networks 

Although the choice of r(-) as the ratio of bessel functions enabled a physical motivation 
to be given for the dynamics, careful examination of the proof of convergence reveals that as 
long as r(-) satisfies certain properties, the convergence result will still hold. First, the function 
r(-) must be strictly monotone increasing with r(0) = 0. Second, r(-) must be analytic. Third, 
we need to ensure that a suitable radially unbounded Lyapunov function exists: 

V = ~ r(a 3 )r(a k )b^ cos (a k - a 3 - B }k ) + £ h(a 3 ) (21) 

j<k j 

where lim^oo = oo, = ar'(a), and h(0 ) = constant. 

The ability to generalize the convergence proof to a class of networks in this manner is 
important when analog implementations of these networks are considered. Although saturating 
nonlinearities can be achieved in analog hardware, a saturating nonlinearity for the magnitude 
of a complex number which leaves the phase unaltered is more complicated [9]. 
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3. Adaptive Control Law for a Variable-Weight Network 


3.1 Motivation for the Adaptive Control Law 

The usefulness of the network presented in the last section would be greatly enhanced if 
the weights were not constrained to be constant. An adaptive control law for variable weights 
is now described which retains the convergence properties of the fixed-weight network - namely, 
the variable weight network with adaptively controlled weights is shown to converge to an 
equilibrium point. The utility of the rigorous proof of convergence for the fixed-weight network 
is that it can be extended to more general and useful networks, of which the adaptive control 
law described here is an example. 


The mathematical motivation for the adaptive control law comes from viewing the dy¬ 
namics and Lyapunov function abstractly and performing some calculations. Abstractly, for the 
fixed-weight case we have 


v 

V(v,w) 

V(v : w) 


/( v,w) (dynamics) 
(Lyapunov function) 


dv ,, , 

- < f(v,w),f(v,i 


Now letting some of the weights be feedback functions, we have 


provided 


v = f(v, w(v)) + g{v) (dynamics) 


V(v,w(v)) 

V(v,w(v)) 


(Lyapunov function) 

w{v)) + g{v)) 
k g{v). f(p q(v) > 




V dv dw dv J 
- < f(v,w(v)) -\ 


( dV dw \ 
V dw dv ) 


T) = — < g(v),rj > . 


( 22 ) 


(23) 


(24) 
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In the transformed coordinates, this condition becomes 

= Hi'ftr’ifiai )<?, (y) ■ ■ ■ fir'(jia r ,)g n (y) 

air(Pa\)g n+ i(v) ■ ■ ■ a n r((3a n )g 2n (v)]. (25) 

Suppose unit j interconnects units /] and l 2 , and all other weights are constants. Fur¬ 
thermore, suppose bi t j 2 depends only on a,j and Qi x j 2 depends only on aj. Then for V as in 

(13), 

= [O'" 0 -r(f3a h )r(f3a l2 )^^-cos(ai 2 -a h -e luh ) 0---0 

0---0 - r{/3a h )r{/3ai 2 )bi u i 2 sin (a h - a h - 0 "-f| 

(26) 
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Generalizing to an arbitrary number of variable weights, we have 

p f 1 if bi u i 2 e' 0l i’ 1 * = di u i 2 r{Paj)e ia i 

h,h | 0 otherwise 

dj = ~ a j + Y r (@ a k)bjk cos (a k - aij - 6 jk ) 

k 

+ Y I h,i 2 d h,h r (P a h) r (P a h) cos (a h - a h - ay) 
h,b 

dj = —(J2 r (P a k)bjk sin(a fc - ay - () jk ) 
a i k 

+ Y l3 hh d h ^r{Pa h )r{Pai 2 ) sin(cq 2 - a h - ay)) (30) 

k,h 

which (provided the change of coordinates is nonsingular) is equivalent to 

jj _ ( 1 if w h,h = d h,h r (0\ x jl)-fi]\ 

11,12 | 0 otherwise 

Xj ■ ■ Xj ■ Y r U jx k )^ w *ik 

+ Y ty/hMHfAxiAMPlxhl) |^ 2 | |^| > (3i) 

where the conditions b^j^e***' l * = d^j 2 r{(d<ij)e m: > and wi x j, 2 = di ly i 2 r((3\xj\)-^ simply indicate 
that unit j is serving as the interconnecting weight between units l\ and I 2 , with the sense of 
the connection (recall that w k j = w* k ) taken into account. 


3.2 Proof of Convergence for the Adaptive Control Law 


To prove convergence of the adaptive control law, we start with the dynamical equations 
just given, (30)-(31), along with the Lyapunov function 

V = ~ Y r{Paj)r((3a k )b jk co s(a k - atj - 0 jk ) 

j<k 

-T Y [ /l«,r(/t« ; ) + log (27r/o(/l« ; ))V, (32) 

I 

where now we may have bj k = dj k r(/3ai) and 6j k = icq for various j, k, l. 


The new calculation of V gives: 

V(y) = -Y\f dr '(f da j)\- a 3 + Y r ^ a k) b jkCos(a k -a j -e jk ) 
# 4 L k 
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( 33 ) 


1 2 

+ ^ I h,iAite r (P a ii) r (P a i2) cos ( a i2 ~ a h -ay) 

h,h ’ J 

+ r(j3a j) i J2r(f3a k }bj li sin(a fe - tty - 6 jk ) 
a j L fc 

1 2 1 

+ Z! 7 /i,/2^i^ r (/ 3a /i) ? '(/ 3a /2) sin ( Q! /2 - Oil - O';) f- 
h ,*2 ’ J J 

Prom this point on, the proof of convergence is basically the same as the convergence proof for 

the fixed-weight case. The reason for labeling the feedback law an adaptive control law is that 

the original dynamics were linear in certain parameters (the weights), which are now adapted 

according to a feedback law which guarantees convergence. In this way, coupled oscillator 

networks can be designed to adapt in the presence of, for example, fixed but (a priori) unknown 

weight values. 

3.3 Application of the Adaptive Control Law Convergence Result 

The adaptive control law just derived is in the form corresponding to equation (2) rather 
than equation (1) for the fixed-weight case. Therefore, we need to determine how equation 
(1) should be modified to correspond to equation (31). A calculation (shown in [9]) gives the 
required modification to (1): 

Vi = 

\ x j\ 

x $ = y* w jk+ u j-J 2 ^h^y^^hD-rK 

k =i h,h 1 hl 

% = • ( J /i,l2 d h 7 j)fa d j,h) r (PM)r{P\x h \) |^| 

V$ — r(#]«y|)r^7 equilibrium. (34) 

\ x j\ 

An example illustrating how this adaptive control law might be used is discussed in [9,10]. 

There is an interesting implication of the adaptively controlled network convergence result 
in terms of hierarchical control of coupled oscillator networks. If two or more networks are 
arranged in a hierarchical fashion, with the units of one network serving as the weights for the 
next network in the hierarchy, the convergence result implies that feedback can be applied from 
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lower levels to higher levels and stability will be maintained, as long as the adaptive control law 
is obeyed. Consideration of these networks of coupled oscillators for hierarchical control systems 
with local and global feedback might therefore be worthwhile. 

4. Network with Auxiliary Control Inputs 

4.1 Convergence Result 

Besides adaptively controlling the weights, another way in which it would be useful to 
extend the basic coupled-oscillator network would be to add auxiliary inputs and determine 
under what circumstances the network is still guaranteed to converge. So consider adding a 
control input term to equation (1): 

Vi = -yi^HP\xj\)-rn 

\ x j\ 

x j = yk w jk + u ji 3 = 1 • ■■■> "■ ( 35 ) 

k =1 

Computing the dynamics for the x 3 alone, in the manner of equation (2), we find 

x 3 = £ r (P\*k\)^g*%k 45 ^ ( 36 ) 

where v 3 = u 3 + v,j. Our ambient space, the space in which the trajectories are considered to 
lie, is still 9? 2ra . Next, we change to polar coordinates using 

x j = a,je ta > 

Wjk = b jk e l6 i k 

Vj = dje‘*i, ( 37 ) 

so that the dynamics become 

Oj = -ferf ^2 r (P a k)bjk cos (a k - a 3 - 6 jk ) + d 3 cos (ip 3 - n 3 ) 
k 

sin (ttfe - a i - +4' sin (^j - «>)j • (38) 
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For now, assume that the Vj are constants instead of functions of time, and at all points 
in 5ft 2 ” where the change of coordinates is valid, consider the new Lyapunov function 

V r (P a i) r (P a k)bjk cos (a k - oij - 0 jk ) - ^ r{fia 3 )d 3 cos {ipj - o> 3 ) 

3<k I 

-Tj^i-PajriPaj) + log (2 tt I 0 (l3a 3 ))]. (39) 

# 

Calculating V(v) = '-j^v (under the assumption that the Vj are constant) gives 

= - Y, | Pr'ipaj) | - Oj + ^r(/3a k )b jk co s(a k - a 1 - 0 jk ) + d 3 cos (i/> 3 - a 3 ) | 

+ r(/3oj]_ 1"^ rCSa*)& jfc sin(a*. - a 3 - 6 jk ) + d, sin(i/j, - «j)l }• (40) 

L fc J J 

Again, from this point on, the proof of convergence with the Vj constant is essentially the same 
as in the fixed-weight case. 

The convergence result can be extended to the case where Uj and Vj are nonconstant in the 
following manner. As long as both Uj and v,j are bounded, Vj = Uj +Uj will also be bounded, and 
hence for any initial condition, the Xj trajectories will remain bounded. Therefore, as long as 
Vj asymptotically converges to a constant value, the coupled-oscillator system will asymtotically 
converge to an equilibrium point [17]. 

4.2 Example: Feedback Loop Phase Shift Compensating Circuit 

4.2.1 Overview of the feedback loop phase shift problem 

This example illustrates how the theory of nonlinear coupled oscillators can be applied 
to a real-world analog circuit problem: phase shift in the feedback path of a complex LMS 
loop configured as a frequency-programmable bandpass filter. In theory, an ideal frequency- 
programmable two-pole linear bandpass filter can be implemented using a single complex LMS 
loop. However, one critical nonideality which must be taken into account at high center frequen¬ 
cies is phase shift through the feedback path due to propagation delays and finite component 
bandwidths. 
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Figure 4.1 shows a single-comp lex-learning-element LMS adaptive filter [18]. The actual 
circuit used is described in [19]. In the absence of feedback path delays and other nonidealities, 
by applying a fixed reference frequency to the “oscillator natural frequency” input, the circuit 
behaves as a bandpass filter from the “exogenous input” to “output” ports. However, for certain 
values of gain and phase shift through the feedback path, labeled “/it” in figure 1, it is well-known 
that the LMS loop becomes unstable, in the sense that the feedback becomes positive. 


GAIN + PHASE SHIFT 



PHASE OF 
TOTAL INPUT 
=X 


STATE 
=PHASEOF 
OSCILLATOR 
=Y 


Figure 4.1: Bandpass filter circuit and oscillator representation. 


In the upper-left corner of figure 4.1 is a sketch of how the system can be viewed as an 
oscillator. The oscillator point of view does not distinguish between stability and instability 
based on whether the feedback is positive or negative. Stability for the LMS model corresponds 
to a stable equilibrium point at the origin for the oscillator system, and instability for the LMS 
model corresponds to a stable limit cycle solution for the oscillator system (the amplitude of the 
oscillations are limited in practice by the range of the analog elements used). To further simplify 
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the oscillator model, only the oscillator amplitude and phase (relative to the unforced natural 
frequency) are retained. This information can be compactly modeled as a time-varying vector 
in the complex plane, and is what is represented by the upward pointing arrow labeled “state” 
in figure 4.1. As will be demonstrated, the oscillator point of view leads to a simple analysis of 
how the LMS loop functions as a bandpass filter. 


4.2.2 LMS loop bandpass filter mathematical analysis 

Each signal in the circuit is represented as a complex-valued function of time with magni¬ 
tude corresponding to the amplitude of the signal and with angle corresponding to the phase of 
the signal. If the signal is high-frequency, then its phase is measured with respect to the unforced 
natural frequency of the oscillator (in this case the bandpass filter programming frequency). The 
goal is to derive the transfer function from the complex exogenous input to the state, which in 
turn determines the bandpass filter characteristic from exogenous input to output. (The follow¬ 
ing analysis is a linearized analysis about the equilibrium point at the origin for the bandpass 
filter oscillator, and thus only applies when the equilibrium point at the origin is stable.) 


Referring to figure 4.1, and treating the integrator block as a single-pole low-pass filter 
with transfer function o), we have the following differential equation for the oscillator 

state y(t ): 

y(t) = -uj 0 y{t) + Kx(t), (41) 

with x(t) is given by 

x(t) = u(t) - yy(t), (42) 


giving 

y(t) = -{uj 0 + Ky)y(t ) + Ku(t). 

Thus, the transfer function from input to state is 

Y(s) = K 

U(s) |Nfi (lOq + /\/<) 

K 

s + (cjq + Kbei e ) ’ 


(43) 


(44) 
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where b = \/jt\ and 6 = L[i. 


Prom this transfer function, we deduce that as the feedback path phase shift increases 
toward instability for the LMS loop, the bandpass filter center frequency shifts higher in fre¬ 
quency, and the bandwidth of the filter narrows, approaching the bandwidth of the low-pass 
filters used as the integrators. Also, as the feedback path phase shift increases, the filter gain at 
the center frequency increases. Clearly feedback path phase shift has a profound effect on the 
performance of the complex LMS loop as a bandpass filter. 

4.2.3 Phase shift compensation circuit 


Figure 4.2 shows a modification to the circuit of figure 4.1 to allow an additional compen¬ 


sating phase shift to be incorporated, which could serve to bring the overall loop phase shift to 


zero. 


GAIN + PHASE SHIFT 



Figure 4.2: Bandpass filter circuit with compensating phase shift. 
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Figure 4.3 shows a nonlinear oscillator diagram for the phase compensation circuit. Oscil¬ 
lators y\ and y% are interconnected so that their stable equilibrium phases differ by the feedback 
path phase shift, Ay. The input u to 7/1 is the bandpass filter programming signal, which causes 
the phase of y\ to allign with the phase of the programming signal. Therefore, the phase of 
converges to the phase of the feedback path phase shift, Ay. The phase of 7/2 is in turn used to 
shift the phase of the bandpass filter feedback signal so correct for the Ay phase shift through 
the feedback path of the bandpass filter LMS loop. 



Figure 4.3: Coupled oscillators for compensating bandpass filter feedback phase shift. 

Figure 4.4 shows the general schematic for implementing the pair of coupled oscillators 
yi and 7 / 2 - As indicated in figure 4.4, complex conjugation simply amounts to a change in sign, 
and hence with the differential circuits described in [19] implies no additional circuit complexity. 
Although not shown explicitly in figure 4.4, it is to be understood that the upper row of multi¬ 
pliers, in particular, have a smoothly saturating input characteristic with respect to the input 
signal from the other oscillator. Although all the analog components have finite range, it is the 
saturating characteristic of the first multipliers (in the multiply-integrate-multiply chain) which 
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are assumed to apply the saturating characteristic in the dynamical equations used to describe 
the coupled oscillator system. 


OSCILLATOR NATURAL FREQUENCY 



Figure 4.4: Coupled oscillator circuit showing complex conjugation. 

The dynamical equations for the coupled oscillators y\ and yi are 

l/i = -m $r(P\v2i**$u I) t U \ 

mi*" + u \ 

i/2 = -?/2+r(/3|yi^|)|^|, (45) 

where ujo is taken to be 1 for simplicity. By the general stability result of section 4, the oscillator 
network consisting of y\ and y<i will converge to steady-state magnitudes and phases. Changing 
to the transformed coordinates, if there is no stable equilibrium point with a,j = 0 for any j, 
then we can conclude that the stable steady-state phases of y\ and ?/2 will be included in the set 

r (P a k)bjk sin(a k - ctj - 6 jk ) + dj sin (i> 3 - Oj) = 0, (46) 

k 

which in this case reduces to 

r(/3ai)5sin(o!2 — a\ — 0) + dsin(ip — au) = 0 
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•(/3a,2)b sin(ci!i — a? + 9) 


(47) 


where y = be l0 and u = de 1 ^. The desired equilibrium solution is the one for which y\ is alligned 
with u and the phase difference between y\ and corresponds to the feedback path phase shift 
of pt: 



The desired equilibrium solution is indeed an equilibrium solution, but there are other 
equilibrium solutions as well. Futhermore, we must carefully rule out the possibility of a stable 
equilibrium point with a\ = 0 or 02 = 0. For this simple two-oscillator network, if the steady- 
state value of u is nonzero, then no equilibrium point has a\ = 0 or 02 = 0. (If the steady 
state value of u is zero, the equilibrium point at the origin can be destabilized by choosing the 
gain /3b sufficiently large [9],) The technique for showing that the desired equilibrium point is 
the unique stable equilibrium point uses the Lyapunov function, which for the two-oscillator 
network becomes 

V = —r(/3ai)r((3a,2)bcos(a2 — ai — Q) — r(/3ai)dcos(ip — ai) 

-T[-p ai r(p ai ) + log(27r/ 0 (/3ai)) - /3a 2 r(/3a 2 ) + log(27r/ 0 (/3a2))]. (49) 


The equilibrium phases are 




(the desired equilibrium) 




(50) 


However, for all but the desired equilibrium point, perturbing the equilibrium angles in the 
expression for V is seen to reduce V. On the other hand, for the desired equilibrium point, 
perturbing the equilibrium angles in the expression for V increases V. Hence, the desired 
equilibrium point is indeed the unique stable equilibrium point. 


24 




Now that we have shown that y\ and yi converge appropriately in figure 4.4, with the 
steady-state phase of yi corresponding to the feedback path phase shift of y, it is clear that 
applying y% directly to the “compensating phase shift” input to the bandpass filter in figure 4.2 
will bring the total loop phase shift to zero. The complex conjugation of y 2 again involves no 
additional circuit complexity, as it simply amounts to a sign change. 

The practical importance of the coupled-oscillator approach to correcting for the feedback 
path phase shift in the LMS-loop frequency-programmable bandpass filter is that it addresses one 
of the major limitations of a widely used and important high-speed analog feedback circuit con¬ 
figuration. The frequency-programmable single-complex-LMS-loop bandpass filter is a special 
case of a more general network architecture, the least-mean-square-error adaptive filter circuit 
used in adaptive antenna arrays, co-site interference rejection circuits, and linear-predictor cir¬ 
cuits for separating coherent from noncoherent signals. Each of these circuits requires feedback, 
and feedback path phase shift is a major limitation at high frequencies of operation. 

One aspect of the feedback path phase shift correction circuit worth emphasizing is that 
the correct compensating phase is determined regardless of the feedback path phase shift over 
the full range from zero to 27r. This property indicates that coupled oscillator circuits may prove 
quite useful for high-speed analog feedback circuit design problems, where signal phase shifts 
are large and difficult to estimate. 

5. Single Feedback Oscillator for Frequency Translation 
5.1 Convergence Result 

So far, we have generalized the basic fixed-weight network by allowing for an adaptive 
control law to update some of the complex weights and by allowing for auxiliary inputs. However, 
in order to guarantee convergence, a key assumption was the Hermitian symmetry of the weight 
matrix. It turns out that a simplified version of the same basic technique for proving convergence 
can also be used for a single oscillator feeding back to itself with an arbitrary weight. In fact, 
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this is precisely the situtation in the complex LMS loop with feedback path phase shift: the 
complex LMS loop with a saturating characteristic in the high-speed feedback path acts as an 
oscillator with the feedback weight determined by the feedback path phase shift. When used to 
implement the LMS algorithm, the complex feedback weight must stabilize the equilibrium at 
the origin, or the circuit is considered “unstable.” However, with a feedback path weight value 
which destabilizes the origin, the circuit is stable in the sense of converging to a stable limit 
cycle, and this behavior can be employed to translate the natural frequency of the complex LMS 
loop viewed as an oscillator to a different output frequency determined by the complex weight 
in the feedback path. One use envisioned for such a circuit is as a reference-frequency generator 
for a continuous wavelet transform (CWT) circuit. 


Figure 5.1 identifies the signals relevant to the oscillator analysis: y is a complex number 
representing the (low-frequency component of the) input to the low-pass filter, a: is a complex 
number representing the low-pass filter output, and c is the complex input signal (supplied as 
voltages corresponding to its real and imaginary parts) providing phase shift in the feedback 
path. (The x and y signals are interchanged with respect to the previous example to simplify the 
algebra.) The signal y is passed through the lowpass filter with corner frequency ujq to produce 
x, so one equation for the circuit is 

—x = —x + y. (51) 

UJ 0 

The high-frequency positive feedback with sigmoidal nonlinearity acts to amplify the complex 
signal cx, and saturate its magnitude without altering its phase. This leads to the second 
equation for the circuit, 

9 = ’'' ,(I “ I) R' (52) 

where /3 is a real constant and ztf fy(\z\) m is a comp lex-valued function which compresses the 
magnitude of its complex argument while leaving its phase unaltered. The small-signal gain of 
the saturation function is parameterized by (3. Combining these two equations gives 


1 

—x = 
UJ 0 


-* + r„( W ) R . 


(53) 
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OUTPUT 



The next step is to change to polar coordinates. Letting 
x = ae ja 
c = de j6 , 

we can rewrite the dynamics as 

—a = sida) cos 0 

UJ 0 

—a = -rnida) sin0. 
u) o a 

Now, we need to make some assumptions on the sigmoidal function rg(-). First, assume 
that the parameter (3 simply multiplies the argument of rg(-). i.e., 

rp(a) = r((3a) Va,/3e$R, a,/3> 0. (58) 

Second, r(-) must be strictly monotone increasing with r(0) = 0. Third, we will assume for 
convenience that r(-) E C°°. Finally, we require, as in section 2.4, that a function h(-) exist 
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satisfying 


oo, 

ar'(a), and 

constant. (59) 

These assumptions on r\y(-). which are not overly restrictive, are required for the following 
convergence analysis, which is used to conclude that the magnitude a of x converges to an 
equilibrium value regardless of initial conditions. 


h(a ) 

dh 

da 

m = 


To prove convergence of the oscillator output amplitude, define the Lyapunov function 


(60) 


We first observe that our assumptions on r(-) imply that V is radially unbounded in its argument 
a (recall that V(a) is radially unbounded in its argument a if V(a) —>■ oo as a —> oo). Next, 
calculating V(a) = ^-d, we obtain 


dV 

da 


—fddr 1 ((3da)r((3da) cos 0 + /3— 
da 


V(a) 


ddr'{(Ida) [ a r (ddxi) cos 6} 

dV . 
da a 

lidr'(liday a ^ x(dda) cos 0 ~. 


(61) 


(62) 


The assumptions on r(-) are sufficient to conclude that V(a) < 0 Va, and V(a) =0 if and only 
if 

r(dda) cos 0 = 0, (63) 

which holds at a point x = ae^ a if and only if it is an equilibrium point of the dynamics. (The 
singularity in the polar change of coordinates poses no problem because it is easy to see that 
the origin is an equilibrium point. For the circuit to work as an oscillator, we will want the 
equilibrium point at the origin to be unstable.) Combining the radial unboundedness of V(a), 
the fact that V(a) <0 and V(a) = 0 only at equilibrium points, and the observation that in fact 
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the dynamics for a actually follow the negative gradient of V(a), we can conclude by the same 
arguments as in the previous convergence analyses that a converges to an equilibrium value. 

5.2 Example: Continuous Wavelet Transform Circuit 

5.2.1 Overview of the Continuous Wavelet Transform Application 

The continuous wavelet transform (CWT) is currently seen as a potential alternative to 
digital signal wavelet processing in certain application areas in which the digital approach is 
too slow for real-time processing. Passive monitoring of the electromagnetic environment, radar 
systems, communications, and data compression are examples of potential application areas for 
the continuous wavelet transform. 

An analog (e.g. microelectronic) CWT approach is based on the idea that the CWT can 
be realized using a bank of bandpass filters. Furthermore, because resolution in the time domain 
as well as in the frequency domain is intrinsically important for the CWT, the bandpass filters 
can be second-order, the lowest order possible for a bandpass filter. 

Within a CWT system, there are two uses envisioned for microelectronic oscillator circuits. 
First, bandpass detectors implemented in the form of synchronous receivers require reference fre¬ 
quencies to be available to mix with the receiver input signal. As a reference frequency generator, 
the feedback oscillator circuit would be operating in its steady-state mode of operation. 

The second CWT use for the microelectronic oscillator circuit would be to generate an 
approximation to the wavelet corresponding to the bandpass filter impulse response functions. 
The impulse response of a second-order bandpass filter is a burst at the center frequency of the 
filter with an exponentially decaying envelope whose time constant is related to the bandpass 
filter bandwidth. The transient response of the single feedback oscillator circuit is a burst at 
a frequency determined by design and with an exponentially growing envelope. Therefore, the 
bandpass filter with the same center frequency and bandwidth corresponding to the exponential 
time constant of the envelope serves as a matched filter for the signal generated by the oscillator 
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circuit. 


5.2.2 Design Equations for Steady-State Operation 

Figure 5.2 shows the single feedback oscillator circuit acting as a quadrature reference 
frequency generator for a CWT system. The sigmoidal transfer characteristic is simply the 
input saturating characteristic of the multiplier which multiplies the feedback signal by the 
high-frequency reference input, and hence is not a distinct component. Furthermore, the low- 
pass filter is just a capacitor placed across the differential multiplier outputs, and the summers 
are simply nodes where currents combine. Therefore, the oscillator circuit really only consists 
of 10 multipliers, and it provides both I and Q output signals (90° out of phase). 


I IN (Fr) Q IN (Fr) 



Figure 5.2: Single feedback oscillator frequency translator. 


From the convergence analysis, we have the following dynamical equations for the oscillator 
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output: 


—ci = —fk+^sida) cos 0 
UJ 0 

—a = -rp{da) sin 6. 


(64) 

(65) 


The convergence analysis showed that the output amplitude a converged to a constant value, so 
that in steady state, 

— a + rp(da) cos 6 = 0. (66) 


The steady-state equation for a, which represents the output signal phase with respect to the 
oscillator input frequency, then becomes 

—Q! = tan0, (67) 

UJ 0 

where 6 is assumed to be constant. Hence, the phase of the output signal, in steady state, 
advances at a constant rate given by wotan 6, which means that the output is frequency-shifted 
with repect to the input by cJotand. 


Thus, the output frequency of the oscillator circuit is given by the input frequency plus 
a term which depends on RC values (u>o) times a term which is given by dc electrical inputs 
(tan0). Therefore, if a number of oscillators which are identical except for geometrically scaled 
u>o values are driven with the same input frequency, the electrical input c = de^ 6 can be used 
to correct for processing uncertanties in the ojq values. This is an important feature for a 
microelectronic circuit, because while ratios of time constants can be made relatively accurately 
on an IC, the absolute values have a very large uncertainty (as high as 50%). Furthermore, 
using feedback control, 6 could be controlled to maintain the correct frequency ratios despite 
temperature changes. 


Examination of the dynamics for a, equation (64), reveals that in order to destabilize 
the origin as an equilibrium point, |0| must be sufficiently close to zero and (3da must be large 
enough to overcome the decay term —a. The larger (3d is, the larger |0| can be, up to 7r/2, where 
the feedback is guaranteed to become negative. If 0 = 0, then the small signal gain through 
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the feedback loop must be greater than unity to prevent the oscillator output from decaying. 
In practice, there is a tradeoff between having a low feedback loop gain (to minimize power 
dissipation) and control authority through 0. 

Even though the steady state output amplitude depends on both d and 0 , the magnitude 
and polar angle of the complex input c, the output frequency only depends on 0 and is indepen¬ 
dent of d. Therefore, the output frequency and amplitude can be tuned sequentially, another 
nice feature of this oscillator circuit. 

5.2.3 Design Equations for transient operation 

For the transient analysis of the circuit starting from an initial condition near the origin 
so that the output appears as a sine-wave burst with exponentially growing envelope, we need 
to reexamine the dynamical equations for a and a. If we assume that the slope of r(-) is unity 
at the origin, then the dynamics become, approximately, 

—a = ((3dcos0—l)a (68) 

u > 0 

—a = (3d sin 0. (69) 

UJ 0 

Both the output frequency shift u>o/3d sin 0 and the time constant associated with the exponential 
growth, 1/[wo(/3c?cos 0 — |||;.,depend on d and 0. The design equations for this case are thus two 
equations in two unknowns. In fact, since ujq is also a design parameter, many combinations of 
output frequency and envelope time constant can be obtained. 

6. Implementation of Coupled Oscillator Circuits in Analog CMOS 

To illustrate one approach for implementing the oscillator dynamics described in this 
work in analog CMOS hardware, consider the single feedback oscillator circuit of figure 5.2. 
The transistor-level circuit design basically comes down to deciding what type of four-quadrant 
multipliers to use for the ten multipliers appearing in the circuit, and then ensuring that the 
small-signal gain, sigmoidal nonlinearity, and lowpass filter time constant are correctly accounted 
for. The two multipliers whose outputs go to the low-pass filters are identical, the four multipliers 
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Figure 6.2: Simulated star curves for multiplier with saturating input characteristic. 
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7. Conclusion 


To summarize, convergence results for a class of networks of nonlinear coupled oscillators 
(or directional units, depending on the point of view taken) have been presented. Physical 
motivation has been given for the simplest network considered, but the convergence results for 
the rest of the networks are based solely on the adaptability of the original Lyapunov function 
arguments to the various networks. 

The first modification to the fixed-weight network was the adaptively controlled network, 
which might be of interest for hierarchical control in systems with both local and global feedback. 
The second modification was the incorporation of external control inputs to the coupled oscillator 
network, and the example discussed was a pair of coupled oscillators for correcting for the 
feedback path phase shift of a complex LMS loop for adaptive filter applications. The third 
modification yielded a single oscillator with feedback through a complex weight, producing 
a circuit of potential interest for continuous wavelet transform applications. Analog CMOS 
implementation of the coupled oscillator dynamics was also briefly discussed. 

This work represents a first attempt at applying a particularly basic form of coupled 
oscillator network to actual engineering problems. What the most useful oscillator network 
paradigms are, to what extent oscillator networks can be used in hierarchical control systems, 
and what the best implementation techniques are for high-speed analog circuit implementation 
all remain open questions. 
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